• Build top 10 packages [DONE]

    • Couldn't build setuptools because it depends on setuptools
    • PyCrypto build couldn't complete because of runtime error
    • Others (simpleJSON, pip) because we couldn't build JinJa2
    • JinJa2 and some others broke because of naming errors
  • Clean up pypi-conda-build

    • Better logging methods [DONE]

      I can create a yaml file something like this

      packages:
        - name: setuptools
          recipe:
              status: True
          build:
              status: False
      
        - name: sympy
          recipe:
              status: None
          build:
              status: None
      

      The value will be None if we haven't tried the operation yet, True and False depending on the status of the operation.

    • Use the yaml file specified above to choose which package to build and which not to build.


  • I cleaned up the scripted a bit, they all uses yaml files now instead of simple list of package names in a plain text file. The former files are good with simple shell one liners but with python scripts yaml provides more flexibility.

  • I first tried to build top 25 packages.The script could create recipes for 24 out 25 packages, the only exception was https://github.com/conda/conda-build/issues/415. And I was successful in automatically building 17 out of 25 packages. The failures were 'setuptools', 'pip', 'PyYAML', 'MarkupSafe', 'Jinja2', 'certifi', 'pycrypto' and 'cffi' setuptools failed because it dependes on setuptools. Other packages like PyYAML and Jinja2 failed because of some issue due to name normalization, I'll look deeper into it. pip and MarkupSafe failed because they depended on Jinja2. pycrypto compiled correctly but it failed an import test. There the error is similar to the issue https://github.com/ContinuumIO/pypi-conda-builds/issues/1. Later Ilan told me that all these packages are part of conda package and I need not build them.

  • I want to build a simple report script to track the progress. I should have how many packages we were successful in building, which packages we failed to build and why. For the packages we build I can mention if it is part of anaconda.